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CLOSED - CAPTIONED TELEVISION PROGRAMMING 

SEARCH 



PLEASE ENTER YOUR EMAIL ADDRESS AND 
THE KEYWORD OR PHRASE YOU WANT US 
TO SEARCH FOR. IF YOUR KEYWORD OR PHRASE 
IS FOUND, YOU WILL BE NOTIFIED BY EMAIL 



EMAIL: 

KEYWORD 
OR PHRASE: 
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YOU HAVE ENTERED " TV EYES " AS YOUR KEYWORD. 



WHEN YOUR KEYWORD IS FOUND, WE WILL NOTIFY 
YOU AT YOUR EMAIL ADDRESS, USER@.USERSYS.COM 
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CONTROL 
BELOW TO ADD, 
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ADD KEYWORD OR PHRASE 

USER: DIVES@VICT0RYSYS.COM 

KEYWORD OR PHRASE TO BE ADDED: | | 

PLEASE CONFIRM THE TYPES OF PROGRAMMING YOU WANT US TO 

WATCH: 

0NEWS 0FINANCE 0KIDS 0 ENTERTAINMENT 
0 SPORTS 0 PUBLIC AFFAIRS/POLITICS 0MISC. 
0 ADVANCED FILTERING 
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EDIT KEYWORD OR PHRASE PREFERENCES 



USER: DIVES@VICT0RYSYS.COM 



KEYWORD OR PHRASE TO EDIT: SELECT KEYWORD 



PLEASE CONFIRM THE TYPES OF PROGRAMMING YOU WANT US TO 

WATCH: 

0NEWS 0 FINANCE 0KIDS 0 ENTERTAINMENT 
0 SPORTS 0 PUBLIC AFFAIRS/POLITICS 0 MISC. 

0 ADVANCED FILTERING 

EDIT 
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DELETE KEYWORD OR PHRASE 



USER: DIVES@VICT0RySYS.COM 



KEYWORD OR PHRASE TO BE DELETED: SELECT KEYWORD 



DELETE 
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1300 



DAVID IVES 

FROM: RESULTS@TVEYES.COM 
SENT: TUESDAY, SEPTEMBER 7, 1999 9:40 AM 

TO: -DIVES@VICT0RYSYS.COM 
SUBJECT: YAHOO 

YOUR KEYWORD(S), YAHOO, WAS RECENTLY SPOKEN ON CNBC DURING 
SQUAWK BOX. 

TUESDAY, SEPT. 7, 1999 AT 9:39 AM 

LOSSES TO REFLECT THE DIVIDENDED TO PREFERRED SHAREHOLDERS. 

INTEL DOWN A BUCK. AMAZON DOWN 1 . YAHOO! DOWN 1 

FOR DETAILS. VISIT http://WWW.TVEYES.COM/DATABASE/ 

EXPAND.ASP?IN=237634&KEY=YAHOO 

1302 

BE SURE TO FOLLOW THE ABOVE LINK TO KEEP YOUR ACCOUNT ACTIVE FOR 
THIS KEYWORD. 



FIG. 13 
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YOUR KEYWORD(S): YAHOO 



1400 



^ VIEW OTHER HITS TODAY ^ 
CNBC 9/7/99 - 9:38:49 

AM WARBURG DILLON REED REITERATES A 

BUY ON APPLE AND REACHED A 
SETTLEMENTMENT IN A SHAREHOLDER 
DERIVATIVE AX PENDING SINCE 1996. 
WARBURG DILLON REED REITERATE AS BUY. 
DURAMED DOWN, A LOSS OF 7/16, RESTATE 
'86 -- 897 AND '98 EARNINGS. LOSSES TO 
REFLECT THE DIVIDENDED TO PREFERRED 
1402 SHAREHOLDERS. INTEL DOWN A BUCK. AMAZON DOWN 1 . 

— YAHOO ! DOWN 1 . CMGI DOWN 9/6 AND THE CHIP SECTOR DOWN 
FRACTIONLY, BACK TO YOU. MARK: THANK YOU VERY MUCH , 
TOM COSTELLO. LETS SHOOT OVER TO DAVID FOR A QUICK 
UPDATE ON WHAT'S MOVING. DAVID; THANK YOU, MARK. AS I'VE 
BEEN DO, CONTINUE TO FOCUS ON VIACOM AND CBS. 
INCREDIBLE NUMBER OF BRAND NAME ASSETS THEY ARE 
GETTING TOGETHER THERE AND WHEN THE BANKERS AT EVER 
CORE AND MORGAN STANLEY WILL PUTTING THIS TOGETHER, 
WHICH WAS A SHORT AMOUNT OF TIME, THEY EXPECTED THE 
VIACOM STOCK UP SHARPLY TODAY, SOME SPECULATED A 15 
TO 20% RISE. WE HAVEN'T SEEN THE TRADING YET, BUT MARIA 
INDICATE IT HAD WOULD IN THE OPEN SHARP LEHIGHER AT THIS 
POINT T. IS AN AT MARKET DEAL. IT IS OPEN, SAYS JOE. JOE, I 
BIKE THE B. UP TO 47. DAVID: NOT BAD, BUT NOT PERHAPS 
WHAT THEY HAD HOPED FOR GIVEN THE FACT THEY ARE NOT 
TAKING ON ANY DEBT, THEIR CREATESING A NEW COMPANY 
THAT WILL HAVE A PLACE, AS YOU HEARD CHRIS SAY EARLIER, 
RIGHT AT THE TABLE WITH THE LIKES OF DISNEY, NEWS CORP, 
TIME WARN AND THE LIKE. IT IS A STOCK DEAL, AS WE TOLD 
YOU. KARMAZIN WILL BE PRESIDENT AND COO. SUMNER 
REDSTONE WILL BE THE 
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AUTOMATED REAI--TIMiI CONTINUOUS SEARCHING 
OF CLOSED -CAPTIONED TELEVISION PROGKAMMING 

Cross Reference eo Related Applicacion 

This claims che tjenefit: of United States 
5 provisional Application No- fio/i53,il9, filed 
September S. 19 SB. 

Background of the Invenrinn 

This invention relates to automated searching 
of closed-captioned television programming for 
10 information requested by a user. More particularly, 
this invention relates to automated searching of 
closed-captioned television programming for requested 
informatioi; substantially as that programming is being 
btoadeasr , 

IS Vast amounts of information ranging from 

world news to Ca^un cooking are available today via 
television (TV) , In many geographic areas, cable TV or 
satellite TV providers offer more than one hundred 
television channels . Programming on most of these 

20 channels is broadcast 24 hours per day, seven days per 
week« Many channels are dedicated to a single TV 
network, while otHers may be shared between two or more 
networks that each broadcast during a different time 
slot. Furthermore, many networks provide only 

25 specialized programming, such as, for example, classic 
movies, classic sitcoms, financial news, science 
fiction, comedy, cooking, and cartoons. 



For mosc viewers, however, finding specific 
information on television (e,g,, news of a particular 
corporate merger or of a new drug- entering the market) 
is nearly impossible, even with today's most 
sophisticated program guides. These guides typically 
provide program names, broadcast times and chaimels, 
and perhaps a general summary of the programs' content. 
Accordingly, viewers are left with few alternatives. 
They can review a pxogram guide and then watch or 
record selected programs hoping that one or more of 
those programs will include the sought after 
information. Or, they can cune to a particular channel 
oh which" the desired infornvation is likely to be 
broadcasc , and then hope ttxat it is , Or. viewers can 
just channel surf and hope no randomly come across a 
program just then broadcasting the information of 
interest. These options are all very time consuming 
and in no way guarantee thac viewers will find the 
information they are looking for. 

In view of the foregoing, it would be 
desirable to provide systems and methods that 
automatically and continuously search television 
programming in real time for information requested by a 
user. 

It would also be desirable to provide systems 
and methods chat automatically notify a user in real 
time upon finding requested information in a television 
program substancially as that program is being 
broadcast. 

It would further be desirable to provide 
systems and methods chat automatically continue 
searching for requested information in other television 
programming after that information has been found in a 
television program. 

It would still further be desirable to 
provide systems and methods that upon notifying a user 



- 3 - 



of requested informacion found in a television program 
provide additional inf or-jiation related to the requested 
inf ortnation- 

Summarv of the Invention 
s It is an object of this invention to provide 

systems and methods chat automatically and continuously 
search television programming in real time for 
information requested by a user- 

~- It is also an object of this invention to 

xo provide systems and tnetnods that automatically notify a 
user in real time upon finding requested information in 
a television program subsscantially as that program is 
being broadcast • 

It is a further object of this invention to 

15 provide systems and methods that automatically continue 
searching for requested information in other television 
progi-anmiing after that information has been found in a 
television program. 

It is still a further object of this 

20 invencion to provide systems and methods that upon 
notifying a user of requesred information found in a 
television program provide additional information 
related to the requested information. 

In accordance with this invention, a system 

25 is provided that continuously searches closed- captioned 
television programming in real time for information 
requested by a user. The requested information is in 
the form of keywords or pbrases. The system notifies 
the user in real time upon finding a keyword or phrase 

30 in the closed-captioned television programming. The 
system includes a computer and software executable on 
the computer. The software compares word by word each 
keyword and phrase to decoded closed-captioned 
information substantially as the decoded 

35 closed-captioned information is received by the 
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computer. The software noLifies che user in real cime 
upon finding a keyword or phrase in the decoded 
closed-captioned informacion. 

The system preferably also includes a 
s receiver operative to receive closed- captioned 

television programming, a closed- captioned decoder, a 
file server, dnd raemory for storing decoded 
closed- captioned information and user requested, 
informacion. 

iQ Other features of the invention preferably 

include notification of a successful search by. for 
example^ email, voice-mail, message displayed on a 
user's television screen, or text message sent to a 
cellular telephone or pager. Searches for requested 

15 information continue until the requested information is 
found a presec number of times. Moreover, the 
invention preferably prevents redundant notifications, 
and dLoes not count them, when, for example, retjuested 
information is found multiple times in close proximity 

20 to each other in the same stream of decoded 

closed- captioned information- The invention preferably 
permits users to specify a time period when 
notifications of successful searches can be seiic (e.g., 
a time period when the user is available to wacch 

25 television) , and also provides users with access to 
additional information related to the found 
information. For example, the invention preferably 
provides users with che following: additional decoded 
closed-captioned information proximate the found 

30 Information (e.g., program dialog before and after a 

user's found keyword); a video segment of che parogram 
iu which the requested information was found 
{preferably a 2 -minute segment embodying the found 
information) ; and information from one or more 
35 third-party sources* 



Brief Description of Che Drivings 

Tlie above and other objects and advancages of 
Che invention will be apparent upon consideration of 
the' following detailed description, taken in 
s conjunction with the accoTf^anying drawings, in which 
like reference characters refer to like pares 
throughout, and in which: 

FIG. 1 is a block diagram of an exemplary 
embodiment of a system that automatically and 
10 continuously searches closed- captioned television 

programming in real time in accordance with the present 
invention; 

FIG. 2 is a sample screen display of an 
infoiTttation entry page on the world Wide Meb 
IS (hereinafter "Web" J in accordance with the present 
invent ion ; 

FIG. 3 is a sample screen display of a 
confirmation Web page in accordance with the present 
invention; 

20 FIGS, 4A'B are an exemplary embodiment of a 

search database in accordance with the present 
invention; 

?tG. 5 is an exemplary embodiment of a TV 
programming category database in accordance with the 
35 present invention; 

FIG. B is an exemplary embodiment of a TV 
programing guide database in accordance with the 
present invention; 

PIG. 7 is a sample screen display of a log- in 
30 Web page in accordance with the present invention; 

FIG. S is an exemplary embodiment of a user 
profile database in accordance with the present 
invention; 

FIG. $ is an exen^lary embodiment of an 
3S individual user account file in accordance with the 
present invention; 



FIGS. 10-12 axe santple screen displays of Web 
pages for adding, edicing/ and deleting, respecrively, 
search informacion from a user accounc file in 
accordance wicb rhe present: invention; 

FIG. 13 is a sample email notification sent 
by the system of FIG. l; 

PIG* 14 is a sample screen display of a Web 
page providing additional information related to a 
successful search; 

FIG. 15 is an exen^lary embodiment of a 
publicly- traded company database in accordance with the 
present. invention; 

FIG, 16 is a logic flowchart of an exemplary 
embodiment of software that can be executed on the 
system of PIG. X in accordance with the present 
invention; and 

FIGS- l^A-B are a more detailed logic 
flowchart of an exemplary embodiment of a portion of 
the software of FIG. 16 in accordance with the present 
invention. 

Detailed Description of tiHe Invention 

Many television programs today are closed 
captioned, and the current trend is to close caption 
most, if not all. television programs in the near 
future- Closed-captioned television programming is 
ordinary television programming with captions that are 
typically text of spoken dialog and may be additionally 
or alternatively, for example, explanatory text or 
subtitles (e.g., foreign language text J . Captions 
appear on the screen of a television set or display 
device et5uipped wich an appropriate decoder. Cloeed 
captioning permits hearing- impaired persons and those 
in noisy environments (e.g,, taverns, fitness centers, 
etc.) to more fully enjoy television. 



in noisy environmeutis (e.ij,, caverns, fitness centers, 
ecc) CO more fully enjoy television. 

FIG. 1 silows an exemplary embodiment of a 
: . system' in -accorcaance with che present invention that 
5 automatically and continuously searches 

closed-captioned television programming in real time 
for xnformacion requested by a user. System lOO 
receives closed- captioned television programming from a 
source 102. Source 102 can be, for example, one or 

10 more of the following: a cable TV provider, a satellite 
TV provider, air-wave broadcasts of closed-eaptioned 
television programming, or any otlier known source of 
closed-captioned television programming - 

System 100 includes a plurality of 

IS receivers 104 chat receive television programming from 
source 102. Each receiver 104 is tuned to receive 
programming on a particular television channel of 
source 102. Receivers 104 can be any known receiver 
compatible with source 102, For example, if source 102 

20 is a cable TV provider, receiver 104 can be, for 
example, CATV converter Model a 155 by Inphone 
Electronics Enterprise Co., Ltd., of Taiwan. If 
source 102 is a satellite TV provider, receiver 104 can 
be, for example. Satellite Receiver Model 7M05 E57474, 

2S by Thomson Consumer Electronics, inc-, of Lancaster, 
Pennsylvania, or Dish Pirect Silver Edition Satellite 
Receiver Model HiRD-m, by Hughes network Systems, of 
Gertnantown, Maryland, 

System 10 0 also includes a plurality of 

30 cldsed-captioned decoders lOfi coupled respectively to 
receivers 104 . Decoders 106 decode closed-eaptioned 
information from the closed-captioned television 
programming received by receivers 104, That is, 
decoders 106 strip out closed*captioned information 

35 from the received television signal and convert chat 
information to text, ASCII, or other form suitable for 
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Industries Technology Gr.:>up, Inc., of Ponce Vedra 
Beach, Florida.^ or a Oati Recovery Decoder Model DH 
24lD5t, by EEG Enterprises, Inc., of Farttiingdale . New 
" York-"* 

$ Although eight receivers 104 and eight 

decoders 10 6 are shown in FIG. i for illustrative 
purposes, system 100 can include other nurabers of 
receivers 104 and decoders 106- 

server loa is preferably a file server that 

iQ receives information from one or more users llo* A 
file server is a sophisticated device (often a 
computer) chat scores, inaintains, and manages files as 
users request, change^ and store them. Users 110 are 
coupled to server 108 preferably via the Internet 112. 

IS and server 108 is further preferably an HTTP (hypertext 
transfer protocol) server chat provides a Web site at 
which users iio enter and odit information to be 
searched for and at which users lio can review 
successful search results. Alternatively, users iia 

20 can be coupled to server 108 directly from their 

personal computers (PCs) or workstations, or via an 
intrajiet or any other suitable network. Server 108 is 
preferably a computer thac preferably has dual Pentium 
800 megahertz processors and 2 gigabytes of random 

25 access memory (KAM) . Server 108 preferably runs SQL 
(Structured query language* server software such as 
that offered by, for example, Microsoft Cojrporation, of 
Redmond, Washington, 

Memory 114 is coupled to server 108 and 

30 prefexably includes databases of user information and 
decoded closed-captioned information. Memory 114 is 
preferably disk space having preferably 10 0 gigabytes 
of storage. Alternatively, memory 114 can be any other 
suitable storage device. 

3S Computer 116 is coupled to decoders lOS and 

server 108 and is preferably PC-compatil>le having 
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preferably a Pencium-3 soo megahercz processor, 128 
megabyces of RAM, and a ID gigabyte hard disk, 
Compuner lis preferably has at lease eight parallel 
input/output channels and a multi-port PCI (peripheral 
S component interconnect) board for receiving at least 
eight parallel streams of decoded closed- captioned 
information. The multi-port PCI board can be, for 
example, a COMM -rB PCI board by Sealevel Systems, Inc., 
of Liberty, South Carolina. Additional computers 116 

10 can be coupled in parallel to receive additional 
parallel streams of decoded closed- captioned 
information from additional television channels 
received from source 102. Alternatively, computer 116 
can be a mid- size or mainframe general purpose computer 

IS preferably having multi-processing capabilities and 
preferably having many more than eight input /output 
channels for receiving decDded closed-captioned 
information , 

Computer ilfi executes software 11^. described 

20 in more detail below, that compares each stream, of 

decoded closed- captioned iaformation to the information 
requested by users. This comparison occurs in real 
time as the decoded information is received from 
decoders 1Q6. When requested information is found in 

2s the decoded closed-captioned information, software 1X7 
notifies via server 108 the user 110 that requested the 
information . 

system 100 preferably also includes a 
computer iia. similar to computer 116, Computer 118 

3o includes a video capture card that receives television 
programming from receivers 104 • The video capture 
card- can be, for example, .in Ospj:ey*^-ioo by 
ViewCast.com, Inc., of Dallas. Texas, or a Studio DCXQ 
Plus by Pinnacle Systems, Inc., of Pittsburgh, 

35 Pennsylvania. Computer lis executes software X2Q that 
captures television progratr^ming from the video capture 
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card preferably u^ing a Microsoft compliant Visual 
Sasic control included with software such as, for 
example. RealProducer Plus software Jay RealNecworJCs-com 
(i.e., RealNetworks, Inc • J , of Seattle, Wasfcington, 
5 Software 12 0 captures televiaion programming 

from each receiver 1Q4 in preferably about 2 -minute 
segments, and stores each 2 -minute segment in a file 
that includes the date and the start and end broadcast 
times of the segtnent. Preferably these files are 

10 stored in memory 114, with filenames preferably 

associated with the television chazmel or network from 
which the segment was broadcast- When a user's 
requested information is found in decoded 
closed-captioned information, the user can request 

IS system lOo to download, or to display at system loO's 
Web site, a 2 -minute video segment corresponding to the 
decoded closed-captioned information in which the 
requested information was found. Preferably, 
software 120 creates the 2 -minute video segment by 

26 copying and asseinbling, as necessary, cont;igupus 
portions of stored video segments such that the 
requested information occurs in che created video 
segment preferably after about the first 15 seconds* 
These video segments can be displayed using, for 

25 example, RealServer software by RealNetworks -com. 

System 100 operates preferably as follows: 
information is received from a user xxo preferably at 
system lOO's Web site. A preferred embodiment of an 
information entry Web page 200 is shown in FIG. 2 in 

3C accordance with the present invention. A user 110 
preferably enters an email return address at input 
entry field 202. This is the address to which 
notifications of found information will be sent. 
Information to be searched for is entered at input 

3S entry field 2 04 in the forin of a keyword or phrase. A 
keyword is a single word or alphanumeric character 
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ennry field 2 04 in tiae fo:rm of a Iceyword or phrase. A 
keyword is & single word ox' alphanumeric characcer 
3T;rang- phrase is any nv:niber of keywords (or 
alphanumeric character str-ingsj grouped together. 
5 (Here ina ft err the term "keyphrase" denotes both 

"keyword" and •'phrase.'*) Alternatively, a user can 
provide information to sysi^em 10 0 by email, facsimile^ 
telephone, or other suitable method. 

System 10 0 preferably confirms the 
10 information received from user iio via a confirmation 
Wei> page. FIG. 3 shows an exemplary embodiment of 
confixTnation Web page 300 in accordance with the 
present invention. Confirmation Web page 3 00 displays 
the entered keyphrase 3 02 a;:id email address 304, and 
IS preferably allows user HQ to modify received 

information preferably via hyperlink 3 06, which returns 
user 100 to information entry Web page 2Q0. A 
hyperlink is a connection between an element (e.g., 
word, phrase, or symbol) in^ for example, an email, and 
20 another hypertext dacumenc. file, or script (e.g., a 
Web site page) . 

Server 10 S stores information received from 
users preferably in a database in memory 114. PIG, 4A 
shows an embodiment of search database 40 0 according co 
25 the present invention. Database 4 00 lists keywords and 
phrase's in columns 402 and 404, respectively, and lists 
associated email addresses in column 4 06 to which 
notifications are sent when keywords or phrases are 
found. 

30 System IQQ preferably allows users to limit 

searches to one or more particular cypes or categories 
of television programming. FIG. 5 shows an exemplary 
embodiment of a database SCO maintained by system loo, 
and preferably scored in memory 114, that lists various 

35 program types S02 and categories 504 that users 110 can 
specify when entering their keyphraae. Thus^ for 
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example, a user HQ can eaier a pliraee "stock marXet" 
and limit Che search for rhac phrase zo celevision 
programming categorized as news and finance. 
. Similarly, a user 100 can limit a search co one or more 
5 program types, such as. for example, daytime soaps, 
talk shows, and games. 

A user 110 'a selection of programming types 
and categories is also stored in search database 400, 
as shown with respect to selected program categories in 
10 columns 406-414 of PIG, 4B, Additional columns can be 
added to" database 40 D to indicate selected program 
types and other options, some of which are described 
below. 

* System lOO preferably maintains and stores in 

IS memory 1I4 a TV programming guide database, an 

embodiment of which is shown in FIG. 6 in accordance 
with the present invention. Database 600 lists, for 
example, television networks whose programming is 
provided by source 102. Database €00 also lists 

20 titles, types/ categories, and broadcast times of 

programs broadcast by the 1-sted television network's". 
Programming guide data for database 60 0 can. be obtained 
from, for example, cable or satellite TV providers or 
third parties- 

25 Preferably, users can also specify a time 

period during which closed- captioned television 
programmirig should be searched. For example, a, user 
cain ^spe^*cify that information regarding a particular 
sporting event be searched for only during the month of 

30 October- System lOD stores this search-time limitation 
in database 400 and then only searches for the 
requested information in decoded closed-capticned 
infoirmation received during October - 

Similarly, users can preferably specify that 

3 5 seairches for requested information be made in only the 
programming of a limited number of TV networks or 
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channels. For example, a user may specify that 
searches for "inflation" be made in only che 
programming of a particular financial news network. 
Syetem lioo stores this seax-ch limitation in 
5 database 4 00 and then only searches programming in 
. accordance with that limitation. 

In a preferred eirbodiment of the present 
invention, user information is also preferably stored 
and maintained in user files that users can access 

io preferably via a password. PIG. 7 shows an exemplary 
embodiment of a Wel^ page screen in accordance with the 
present invention at which established users can enter 
uheir password to access their files, or at which a new 
user- can establish a password for future access to that 

IS user's file. 

System IQO preferably maintains a user 
profile database listing user IDs, email addresses, and 
passwords. User IDs are assigned by system lOO upon a 
user first establishing a password. PIG. 8 shows an 

20 embodiment of user profile database 8 00 in accordance 
with the . present invention. 

An embodiment of a user account file 90 0 in 
accordance wich the present invention is shown in 
PIG. 5. Each keyphrase entry 902 represents a separate 

^£ search conducted substantially simulcajieously. Upon 
gaining access to their files, users can add. edit, or 
delete search inf ormacion. FIGS* 10, 11, and 12- show 
respective embodiments of Web page screens 1000, 1100, 
and 12 00 in accordance with nhe present invention at 

3 0 which additions, edits, and deletions of search 

information can be entered. Upon users modifying cheir 
account files SOD, database 40 0 is updated accordingly. 

$»Mferably, system 100 performs a preset 
number of successful searches before requiring a user 

3S to request continuation of the same search. As shown 
in PIG. 9, column 904 represents the number of 



notifications retnaining (i.e., the immber of successful 
searches still to be performed) . For example, 
system lOO will automacically continue searching for 
the keywox-d "auto analyst" until that keyword is found 
three times. After the third time, system 100 
preferably resets the notifications remaining counter 
upon the user accessing additional information provided 
by system lOO that pertains to the last successful 
search. This additional information is described 
further below, Alternatively, if afrer the third 
successful search users wish to continue the same 
search, they can reset the notif icacions remaining 
counter by accessing their files via password and then 
clicking on the corresponding button 906. Note chat 
while in this embodiment the preset number of 
successful searches that system IDO will perform is 
three, other numbers of successful searches can be 
preset* 

system 100 preferahly filters successful 
searches, and does not count them, if they are 
redundant. Accordingly, redundant notifications are 
prevented. System IQO preferably performs three levels 
of filtering- First, if the same keyphrase is found 
within close proximity o£ a previous find of that 
keyphrase, the latter find is ignored. 'Close 
proximity" can be defined in teanns of time le.g*, 
within 30 seconds) or in terms of line segments (e.g., 
within 2 0 line segments) . A line segment is about four 
or five words ti»e,. spoken or explanatory text words^ 
not con^uter words) , which about equals a 
closed- captioned line displayed on a TV screen. 

Second, if the same keyphrase is found in the 
same stream of decoded closed- captioned information 
more than a preset number of times within a presen time 
period, those occurrences of that Xeyplxrase e3cceed±ng 
those limits are ignored. For example, system 10 0 will 
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ignore more than chree occurrences of a Keyplirase found 
in Che same scream of dectoded closed-capcloned 
information wichin 30 miiuutes of each other. 

The third filtering that system lOO 
5 preferably performs is a user specified * scop/ repeats" 
filtering. If a found keyphrase appears to have. been 
found in a repeat of the sf.me program in which that 
keyphrase was recently found (e.g., within the last two 
days J , that find would be ignored if the user so 

10 specified, "Stop/repeats** information is stored for 
each uses i.zx column ^^az of dat^abase 400. 

System 100 preferably allows users who do 
not wish to be notified around the clock of successful 
searches to specify a time period during which they can 

IS be notified of successful searches. For example, a 

user may specify that notifications, both real time and 
those indicating or summarizing previous successful 
searches prior to the specified time period, be sent 
between 6:00 PM and ao:00 PM daily, which is when that 

20 user generally has time to review previous search 
results and is available to watch television should 
that user be notified of a CV program being broadcast 
that includes information requested by the user. 

system 100 uses software 117 to find user 

25 requested information. Software 117 compares user 

requested information ti.e., keyphrases) with decoded 
closed-captioned information. Software 117 takes line 
segments of decoded closed-captioned information, 
brea3cs the segment up into its individual words, and 

3 0 Stores those words in an array in RAM or other 
temporary storage* Each word is then separately 
compared to each word of each iceyphrase stored in 
system 10 0 , 

upon finding requested information in decoded . 
35 clbsed-captioned information, system 100 notifies the 
user preferably by email. FIG. 13 shows an eacemplary 
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embodiment of an email 13 00 used to notify a ueer of a 
successful search in acccxaance wich the present 
invention. Alternatively, users can be notified by 
facsimile, voice-mail, a message displayed on their TV 
s screen (e.g., in the form cf a banner or other typa of 
suitable overlay) . a message displayed on their 
computer screen (e.g., in the form of a . 
cickejr- tape -style display] , a text message senc to a 
cellular telephone or pager, or any other suitable 
10 metnbd. 

Notifications preferably include the name, 
broadcasc time, network: . and channel of the TV program 
in which the requesced information was fotmdr and 
preferably a brief portion or snippet of 

15 closed- capnianed cext surrounding the occurrence of the 
requested information. An email notification also 
preferably includes a hyperlink 1S02 to a Web page tbat 
provides addirional closed- captioned information from 
the program in which the requesced information was 

20 found. This additional information is preferably 
proximate the requested information. 

FIG. 14 shows an exen^lairy embodiment of an 
additional information Web page 14 oo that a user can 
access after notification of a successful search- The 

25 user's keyphrase 14 02 Is preferably highlighted in some 
manner so that rhe user can easily see whete in the 
additional informauion the keyphrase appears. 
Alternatively, other means of providing access to 
additional closed- captioned information can be 

30 provided. For example, users can call a specified 

telephone number to either listen to a recording of che 
additional information or order a hardcopy. Or, users 
can receive additional information by email or 
facsimile. 

3 5 System lOO preferably provides users with 

access to related information from sources other than 
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tije program in wliicti clie requested informacxon was 
found. For exainple, systera 10 0 preferably compares 
inf ormacion no be searched for with names of conipaixias 
whose stock ia publicly traded- system 100 preferably 
maintains a database ISOO of publicly- traded companies, 
as shown in FIG. 15, to which a user*s requested 
information is compared. If a user's requested 
information includes the name of a publicly- traded 
company listed in database 1500, then the email 
notifying the user of a successful search preferably 
also includes a hyperlink to one or more sources at 
which that user can obtain^ for exaoiple^ current stock 
market or other financial information about that 
company. 

System 100 preferably maintains a 
ncitifications database that includes a record of every 
email notification sent to users, and of every user's 
access of the additional information provided by 
systetn 100. These records are useful for, among other 
things/ marketing purposes. 

System 100 preferably also maintains, a . 
captioning database that includes a copy of all decoded 
closed-captioned information received over a period of 
time. This period of time is dependent upon the amount 
of storage available for storing the decoded 
closed-captioned information. Preferably, each stream 
of decoded closed-captioned information (typically from 
a particular television channel) is stored separately, 

FIG.- IS represents an exeniplary embodiment of 
software 117 in accordance with the present invention, 
software 117, executable on conrputer 116, includes the 
following functions : searcher 1602 , optional 
replicator 1604, and notifier isos. Notifier I60fi 
preferably includes email nctifier 1608^ TV 
notif ier 1610/ and miscellaneous notif ier. 1612 . These 
functions can be encoded as follows: a single computer 
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program, four modules or subroutines of a single 
computer program, four separate programs appropriacely 
linked togecher. or any ozher program or group of 
programs exficur able on compucer 116. Moreover, if 
5 sofrware 117 is encoded as separate programs, eacb 
program preferably can be executed in parallel on- 
separate con^ucers lie (or on separate processors of a 
mult i -processor computer 11 S) appropriately linked 
togecber such, rbat system 100 operates properly. Each 

ID computer 116 can be customized (with respect to. e.g., 
processor speed, hard disk and RAM capacities, ecc.) to 
effectively and efficiently execute its respective 
portion of software ii7 in accordance with system 100 
bperation and real-time performance objectives, 

15 Searcher 1602 searches an incoming stream of 

decoded closed-capt ioned ixiformation in real time for 
keyphrases ennexed by users. Each word of the decoded 
closed-captioned information is compared with each word 
of each user's keyphrase. A separate duplicate 

20 searcher 16 02 executes in parallel for each stream of 
decoded closed-captioned information received from a 
decoder io6. Each stream typically represents 
programming from a single television channel, "ppon 
finding a keyphrase, searcher 1602 creates appropriate 

25 notification data. 

Replicator 1604 is invoked if the number of 
users requiring notification of a successful find of 
Che same information exceeds a predefined limit. 
Replicator 1604 laimches one or more additional 

30 searchers 1602R as needed to continue processing the 
found keyphrase ie,g-^ checking individual user files 
and creating appropriate nctif ications) . Eacb 
searcher 1602R preferably processes notifications for 
each user having requested the same found keyphrase- 

35 Searchers 16 02R may be functionally the same as 

searcher X6oa or, alternatively, may include only the 
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notifications processing capability of searcher X6o2- 
Tlie found }ceypnrase and si^sociated user data are passed 
to searchers 1602R from siearcher 1602 through 
repXicator 1604, Upon completing its nocificatiozis 
5 processing, each searcher 1602R self -terminates , 
Searchers 1602R allow searcher 1602 to continue 
real-time searching of incoming streams of decoded 
closed* captioned information. 

ITotif ier 1606 preferably nocifies users of 

10 successful finds by email. Email notifier xeos scans 
an email database for records that need to be 
transmitted to users. Each sent email has a 
corresponding record in the database. Email 
notifier 1608 retrieves all pending records in the 

IS email database and processes each one individually. As 
each record is processed and emailed, the record is 
updated accordingly. Optionally, and where 
appropriate, email notifier 1608 adds advertising to 
the email- Preferably, email notifier l6os can execute 

20 on a separate computer lis. 

. Additionally or alternatively to emaiX 
notifications. TV notifier 1610 notifies users by 
overlaying or displaying a notification on the user's 
television screen. TV notiEier isio processes 

2S notification data created by searcher 1602 (e.g.. TV 
program information and appropriate addressing 
information) and transmits the notification 
accordingly. 

Similarly, miscellaneous notifier X612 

30 notifies users by methods other than email or 

television, such as, for example, by sending a text 
message to a pager or cellular telephone {capabXe of 
receiving such a message) . Miscellaneous notifier 1612 
also preferably includes a ticker-tape program chat 

3S users can download to their computer- KTotificatiozi? 



eenc to a user's computer appear on the computer's 
screen as a nicker-cape-iscyle message. 

PIG. 17 repres^nrs a more decailed exemplary 
embodiment of searcher 1^02 in accordance with, the 
present invention. At 1702, searcher 1602 processes 
preferably one line segment of decoded 
closed- captioning, Thac line is broken up into 
individual words and stored in a segment array. The 
segment array is preferably stored in RJ\M or other 
temporary storage and includes the words of at least 
three line segments, 

1704, searcher i602 retrieves a keyphrase 
from search database 40 0 and stores it in HAM or other 
temporary storage. Keyphra.ses are retrieved preferably 
sequentially per user* If the keyphrase is a keyword, 
searcher ie02 preferably first checks the keyword to 
ensure that it is not meaningless. For example, 
keywords such as "the" and "^it" occur too fr6g:uently in 
closed captioning to be of any value as a keyword and 
are thus ignored. {Such words^ however^ may be of 
value in a phrase, and thus phrases are not checked) . 

At i705, searcher 1602 compares a decoded 
ciosed-captioned word to a Keyphrase. If the keyphrase 
is a keyword, a word -to -word comparison is made. If 
the keyphrase is a phrase, zhen searcher 1602 compares 
that phrase with about three closed-capcioned line 
segments, depending on the length of the phrase. 

If the closed-captioned information (i.e., 
word or line segments) does not match the keyphrase at 
1708/ searcher ISO2 retrieves another keyphrase, 
provided that the prior keyphrase was not rhe last one 
in database 4 00 (this is checked at 1710}. If the 
prior keyphrase was the last one, then the oldest line 
segment stored in the segraenc array is cleared and a 
new line segment is processed (broken up into 
individual words and stored in the segment array J . 
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If cJie closed- ^raprioned Information matches a 
keyphrase, searcher 1602 checks at 1712 whether Che 
numhex of users requesting searches of that Jceyphrase 
exceeds a preset nutnber. If it does, searcher 1602 
5 notifies replicator 1604 to help with notifications 
processing. Note that sea:rchers 1602R preferably 
perform 1714, 1716. 1718, 1720, 1722, 1724, 1726, 
and 172 8. 

At 1714, searcheiT 1S02 determines wlierher a 

10 user is authorized to receive a notification by 

checking that user's notifications remaining counter. 
If authorized, an alert flag is set. If not, 
searcher 16Q2 returns Co 1710. 

At 1716, Che fouaid keyphraae is filtered for 

xs redundancy. If the keyphrase is found to be redundant, 
the alert flag is turned off and searcher 16 02 returns 
to 1710. searcher 1602 preferably performs two levels 
of redmidancy filtering- The first level ignores a 
found keyphrase if that keyphrase had been previously 

20 found within a preset number of line segments {e.g., 20 
line segments) . The second level of filtering ignores 
a f oxind keyphrase if that keyphrase had been found in 
the same stream of decoded closed-captioned information 
more than a preset number csf times (e.g, , three) within 

25 a preset time period (e,g-. 30 minutes). 

Searcher 1602 preferably performs at user 
request a third level of filtering intended to prevent 
notifications of requested ±nformation found xn the 
same TV program that may have been broadcast at 
different times. To perform this filtering, system lOC 
maintains a database of the last five email 
notifications per user per found keyphrase. This 
database, includes decoded closed- captioned line 
segments proximate the found keyphrase. If a user 

35 recjuests this filtering, searcher ifioa cakes a. presec 
number of closed-captioned line segment words from 
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before and after clie cur::ently found keyphrase (e.g., 
about: eighc words before and abouc eighc words afcer, 
preferably noE including articles such as ^'a" and 
*cjie'*) / "and compares them to abouc che same number of 
line segment words before and after each of the last 
five occurrences of that 3Ci2yphrase found for chat user. 
If Che words from the current: find match the words from 
any of the last five by a preset percentage, that 
curxent find is considered to be from a repeated TV 
program and is ignored. The preset percentage can 
range,, for example, from 60% to 100%» 

At" 1718, search database 4 00 is checked to 
determine whether the user had selected a particular 
category, type, channel, or TV network: of programming 
CO search. If so, the TV program in which the 
requested information is found is checked. If that TV 
program does not match what the user selected, the 
alert flag is curned off and searcher 1602 renurns 
to 1710, 

Ac 172 0. searcher 1^02 checks the sea.rch 
database 400 to determine whether a particular ti'ttie 
period for notifications was specified. If a time 
period was specified and the current keyphrase find is 
net within that time period, this find and its 
associated information is stored for notification to 
tbat user during the specified time period. 

Ac 1722, search database 400 is checked to 
determine what type of notification was requested 
(e.g,, email, TV, voice-mail, etc.). 

At 1724, searcher 1602 determines the TV 
program title from the TV programming guide database in 
accordance with the channel, date and broadcast time of 
tne closed- captioned programming in which the requested 
information was found. Searcher is 02 then stores this 
information in che notifications database. 
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Not ificac ions ara prepared ac 1726, If an 
email nocificaclon was rtsqaesced. the email is setup as 
follows: zhe subjecc o£ iha email is assigned in 
accordance with i:be keyp:ara6e. If cbe Iceyphrase is a 
phrase, spaces are replaced with Web browser 
compliani: %2Q* If the kayphrase is a keyword^ any 
ampersands concains therei-i are replaced with %2S. The 
user's email address is then assigned. If che email 
address is improperly formatted ce.g.< ineor-rectly 
entered by the user) , searcher 1602 reformats the 
address to point to a system lOO administrator account . 
A snippet of the closed-captioned information (e.g-^ 
about six line segments) is included in the email. The 
following email notification information is stored in 
the notif icacions database: sent date, sent time, sent 
flag, recipient user address, television channel on 
which the information was £aund, scare and end 
positions of the captioning text from the captioning 
database for that channel, keyphrase, television 
program name, current captioning line, prior captioning 
line, and Internet imL address to where this 
notification can be viewed on the Internet- 

The email notification information is then 
compiled. This includes preferably formatting the 
email with HTML (hypertext markup language] , storing 
the header, storing the snippet of closed-captioned 
text that surrounds the keyphrase^ and storing any 
email trailers, such as, for example, a note informing 
the:user that this notification is the user's last 
unless they reset the notifications remaining counter. 
The compiled email inforttiauion, which is now a record, 
is inserted in an email table for email notlfier X608 
to retrieve and send out . 

After the email is sent, the record of this 
notif ieacion stored in che notifications database is 
updated. This database preferably always includes the 
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last five emails for eaci Iceypnrase senc to the same 
user. 

At 1728, the ;aacif ications remaining counter 
is decreased by one- Searcher 1602 then returns 

5 CO 1710. 

Optionally, system 10 o also performs searches 
of closed-caprioned celevision programming for 
predetermined system keyphrases, and maintains a 
database of successful searches. Such a system 

10 iceyphrase database is useful for marketing purposes 
(e.g., to show a potential user how many times and in 
whar television programs a keyphrase of likely interest 
had been foimd) . Searching for and maintaining a 
database of successful searches of predetermined system 

15 keyphrases can also be useEul for creating or enhancing 
stored lists of, for example, publicly- traded 
companies, sports teams, and celebrities. These lists 
may be' of interest to certain types of users ce.g.. 
advertisers looking for a celebrity currently in the 

20 spotlight) . Such lists may also be used to provide 
additional historical information to users recjuesting 
related searches* For example, a user requesting a 
search of a particular publicly-traded company can be 
provided wirh a historical record of television 

2S programs that recently discussed a publicly- traded 
competitor of that company. 

Software 117 performs system keyphrase 
searches substantially identical co, or similar to, 
user requested Iceyphrase searches, including redundancy 

30 filtering. Upon finding a system keyphrase/ the 

information preferably stored in the system Iceyphrase 
database includes: TV program name, dare, broadcast 
time, celevision channel, keyphrase, preferably two 
lines of text from the keyphrase match (e.g., current 

35 line segment and prior line segment:) ^ snam position in 
the captioning database for the current channel, and 



end. position in the capcioning darabase for che current 
channel - 

In sum, system loo advantageously searches 
ciosed- captioned television programming autoraacically 
5 and continuously in real time for information requested 
by users- Syscem XQQ advanrageously notifies those 
users in real time upon finding their recpuested 
information. In other words, system 100 preferably 
receives, decodes, and compares closed- captioned 

10 television programming with information received from 
users ^ and notifies those users of successful searches 
in real time such that in many cases, users may tune to 
the television program in which the requested 
information was found while that program is still being 

IS broadcast. 

Thus it is seen chat systems and methods are 
presented that automatically and continuously search 
clbsed-captioned television programming in real time 
for requested information. One skilled in the art will 
20 appreciate that the present invention can be practiced 
by other than the described embodiments, which are 
presented for purposes of illustration amd not of 
limitation, and the present invention is limited only 
by the claims which follow. 
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WE CLAIM: 

1. 7^ system that contiiiuously searches 
closecj-eapcioned television pirogrammiag in real time 
for information requested )3y a user, said eyscem 
comprising : 

5 a coirrpurer bavlng a processor, random 

access memory, hard disk, and at least one input/output 
port operative co receive information to be searched 
for from a user and to rec-sive decoded closed-captioned 
television programming; and 

10 software executable on aaid computer to 

compare said received information to said decoded 
closed' captioned information substantially as said 
decoded closed-captioned information is received by 
said computer and to notify said user in real time of 

IS finding said received information in said decoded 
closed-captioned information. 

2 . The system of claim i wherein said 
received information comprises a keyword. 

3 . The system of claim 2 wherein said 
software compares each word of said decoded 
closed-captioned information to said keyword - 

4 . The system of claim i wherein after 
finding said received information in said decoded 
closed-captioned information, said software continues 
to compare said received information to decoded 
5 cXosed'captioned information received after said 
requested information is found. 



5, The system of claim 4 wherein said 
software does not notify said user pf a s\ibsequent find 
of said received information when said subsequent find 
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is within close proximity of a previoiis find of said 
5 received inf ormanion, 

" 6. The system of claim 5 wherein said close 
proxitnicy is a time period of less than about 30 
minutes • 

7, The system of claim 5 wherein said close 
proximity is about 20 line segments of said decoded 
ciosed-captioned informacion- 

8 , The system ot claim 1 wherein said 
received information and said decoded closed- captioned 
information comprises words of text, said software 
comparing each text word of said received information 

5 to each text word of said decoded closed-captioned 
information. 

SJ' The system of claim i wherein said 
random access memoxy has az lease about 50 megabytes of 
storage, said hard disX has at least about 5 gigabytes 
of storage, and said processor operates at at least 
5 about SOO megahertz. 

ao. A system that continuously searches 
closed- captioned television programming in real time 
for information requested by a user, said system 
comprising : 

s a receiver operative to receive 

closed-captioned television programming; 

a closed-captioned decoder coupled to 
sa.id" receiver , said decoder operative to decode 
closed- captioned information from said closed-capcioned 
10 programming; 
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a file servar operative to receive 
information no search for from a user, said eerver 
having a processor; 

memory coupled zo said server/ 'said 
memory operai:ive co store said received infojrmacion and 
said decoded closed-captioaed informacion; 

a computer coupled to said decoder and 
to said server, said computer having a processor, 
random access memory, and iiard disk; and 

software executable on said coiapurer to 
compare said received information to $aid decided 
clpsed-captioned information substantially as said 
closed*captioned information is decoded by said decodex 
and to notify said user in real time of said' received 
information found in said decoded clesed-captioned 
information. 

11. The system of claim 10 wherein sai-d 
received information comprises a keyword* 

12. The system of claim 10 wherein said user 
is. notified by email of received information found in 
decoded closed-captioned informacion. 

13. The system of claim 10 wherein said 
computer random access memory has a capacity of at 
least about €4 megabytes, said computer hard disk has a 
capacity of at least about 10 gigabytes, and said 

s computer processor operates at at least about 8 00 
megahertz, 

14- The system of claitn 10 wherein said 
server is a hypertext transfer protocol server-. 



20 
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15, The syscem of claim 10 wjierein said 
server processor operates ai: ac lease about soo 
roegahercz , 

16, The system of claim lo wherein said 
memory is a disk drive- 

17, The system of claim 10 wherein said 
memory has at least about 80 gigabytes of storage. 

IS. The system of claim 10 further 
comprising: 

a second computer coupled to said 
receiver and to said computer, said second computer 
s having a processor, random access memory, a bard disk, 
an input/output port operative to receive television 
programming, and a video capture card; and 

software executable on said computer Co 
capture and score segments of received closed-captioned 
10 television programming. 

19. A method of searching closed-captioned 
television programming in real time for information 
requested by a user« said mechcd comprising: 

(a) receiving information to search for; 
$ (h) receiving closed-captioned 

television programming; 

icj decoding closed-captioned 
information from said closed-captioned programming; 

(d) comparing said received information 
ao to said decoded closed-eapcioned information 

substantially as said closed-captioned information is 
decoded; and 

[e) notifying said user in real time of 
finding said received information in said decoded 

15 closed-captioned information. 
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so. The tnechod of claim 15 wherein said 
received information comprises a keyword - 

21. Tixe method of claitn 19 wherein, said 
receiving informacion comprises receiving information 
via the Internet . 

22 , The method of claim 19 further 
comprising storing said decoded information in a 
database . 

23- The method of claim 19 further 
comprising storing segments of received 
closed-captioned television programming in a database, 

24. The method of claim IS further 
comprising selecting closed- captioned programming 
received during a particular time period with which 
said comparing is to occur. 

25, The method of claim 19 wherein said 
eXosed-captioned television programming is categorized, 
said metliod further comprising selecting 
closed-captioned programming of a particular category 

5 with which said comparing is to occur. 

2^- The method of claim IS wherein said 
closed-captioned television programming is provided by 
a plurality of television networks, said method further 
comprising selecting closed-captioned programming of a 
5 particular television network with which said comparing 
is to occur. 



27. TJie mechcd of claim 19 wherein said 
notrxfying comprises notifying said user via che 
Jncemec . 

28. The mechod of claim 19 wherein said 
notiifyins camprises notifying said user hy email.' 

29. The method of claim 19 wherein said 
notifying comprises notifying said user by facsimile. 

30. The method of claim 19 wherein said 
notifying includes a program name and channel on which 
said received information was found. 

31. The method of claim 19 further 
comprising providing a user with access to additional 
information related to said received information' found 
in said decoded closed-captioned information- 

32. The method of claim 19 wherein said 
notifying comprises providing a hyperlink to enable a 
user to oiitain additional decoded closed-captioned 
information proximate said received information found 
in said decoded closed-captioned information* 

33. The method of claim 19 further.; 
comprising displaying a video segment corresponding to 
decoded closed-captioned information in which said 
received information was found - 

34 . The method of claim 3 3 wherein said 
video segment comprises about 2 minutes of video. 



35, The method of claim 19 further 
comprising comparing said received information to names 
of companies whose scocjc 13 publicly- traded. 



36. The mechod of claim is wherein said 
received information includes a name of a 
publicly- traded company an^ said notifying comprises' 
providing a hyperlink to enable a user to obtain 
financial information pertaining to a said 
piiblicly- traded company. 

37. The method of claim 19 wherein said 
notifying further comprises; i 

specifying a time period when said 
notifying can occur; and 

notifying said user during said ' 
specified time period of real-time finds of said 
received information in said decoded closed- captioned 
information and of finds of said received information 
in said decoded closed-captioned information prior to 
said specified time period. 

38. The method of claim 19 further 
comprising maintaining said received information in a 
file modifiable by said user. 

39. The method of claim 19 further 
comprising preventing said notifying from occurring 
after a first occurrence of said notifying upon finding 
said received information again in said decoded 
closed-captioned information in close proximity to a 
previous find of said received information • 

40. The method of claim 39 wherein said 
close proximity is a time period of less than about 
30 minutes. 



41. The method of claim 33 wherein said 
close proximiry is a abouc 20 line segments of said 
decoded closed-capcioned information, 

42- The method of claim X9 wherein said 
comparing comprises comparing each word of said decoded 
closed- captioned information with each word of said 
received information. 

43. The method of claim 19 further 
con^rising receiving an email address to which 
notifications are to be sent upon finding said received 
informarion in said decoded closed- capcioned 
information. 

44. The method of claim 19 wherein said 
decoding, comparing, and notifying occurs in real -time 
as said closed-captioned television programming is 
received- 

45. The method of claim 19 further 
comprising repeating (a) - (e) at least once. 
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